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Purpose: To examine the effect of a follow-up visit with a primary care physician and/or 
pulmonologist within the first 30 days of hospital discharge on readmissions, emergency 
department (ED) visits, and mortality. 

Patients and methods: This was a retrospective cohort study of 7,102 unique patients 
discharged from a Mayo Clinic hospital in Rochester, MN, and residing in Olmsted County, 
MN, with any mention of chronic obstructive pulmonary disease (COPD) from January 1, 
2004 through November 30, 2011. The study included 839 patients who met study-entry 
criteria. Cox proportional hazards regression was performed to determine the risk of hospital 
readmission, ED visits, and death of patients, with or without a follow-up visit during the first 
30 days postdischarge. 

Results: Our results showed 839 unique patients experienced 1 ,422 discharges with a primary 
diagnosis of COPD. Of the 1,422 discharges, 973 (68.4%) had a follow-up visit within 30 days. 
In a multivariate Cox proportional hazard-ratio (HR) model analysis, occurrence of a follow-up 
visit did not have a significant effect on the risk of the combined outcome of 30-day readmission 
and ED visit (HR 0.947, confidence interval 0.763-1.177; P=0.63). However, a postdischarge 
follow-up visit had a significant effect on 30-day mortality (HR 0.279, confidence interval 
0.149-0.523; P<0.001). 

Conclusion: Postdischarge follow-up visits after hospitalization for COPD did not significantly 
reduce the risk of 30-day readmission or ED visit. However, patients who received postdischarge 
follow-up visits had significantly reduced 30-day mortality. 

Keywords: care transitions, COPD, discharge planning, outpatient follow-up, risk factors 

Introduction 

Title III of the 2010 US Patient Protection and Affordable Care Act for health care 
reform emphasizes reducing readmissions to improve quality and integration of 
care and to reduce costs for Centers for Medicare and Medicaid Services (CMS) 
beneficiaries. Medicare expenditures for readmissions have been estimated to be 
as high as SI 7.4 billion a year. 1 The national average for 30-day all-cause hospital 
readmissions is 19.3% (12.9%-26.3%). 2 The CMS has subsequently made readmission 
rates a priority measure of quality, with penalties that began October 1, 2012 under 
the Patient Protection and Affordable Care Act and associated 2012 rule for inpatient 
prospective payments. 1 

Chronic obstructive pulmonary disease (COPD) is the fourth-leading cause of death 
in the US and the only disease associated with both increasing morbidity and mortality 
over the past 30 years. 3 Resulting in 726,000 hospitalizations and 1 .5 million emergency 
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department (ED) visits in the US in the year 2000, 3 COPD 
has been determined to be one of the top five diagnoses for 
hospital readmission. 1 4-6 One in five patients discharged with 
COPD is readmitted within 30 days postdischarge, making 
COPD not only common but costly 1,4 Hospital admissions 
due to acute exacerbations of COPD affect health-related 
quality of life 7 and prognosis. 8 Its burden to society, as 
expressed in disability life-years, is predicted to rise to the 
fifth-leading cause worldwide for both sexes by 2020. 9 CMS 
penalties for 30-day readmissions currently target congestive 
heart failure, acute myocardial infarction, and pneumonia, 
as these are the CMS's most costly discharge diagnoses, but 
COPD discharges with a 30-day readmission will soon be 
included in the CMS's measures for readmission. 110 

The causes of readmissions are presumed to be related in 
part to poor coordination and quality of care, including timely 
postdischarge follow-up with a physician. However, evidence 
is lacking as to whether specific interventions, such as early 
follow-up, can prevent 30-day readmissions, and it is even 
less clear whether all diagnoses will respond similarly to any 
specific intervention(s). The primary aim of this study was 
to examine the effect of a follow-up visit with the patient's 
primary care physician (PCP) or a pulmonologist within the 
first 30 days after hospital discharge for a primary diagnosis 
of COPD, on readmission, ED visit, and death, collectively 
termed as postdischarge failure (PDF). 

Materials and methods 

We conducted a retrospective cohort study of patients 
discharged from a tertiary care academic medical center 
to their home or to a skilled nursing facility with a pri- 
mary discharge diagnosis of COPD. Our inclusion criteria 
were: 1) patients had to be 18 years of age or older; 2) 
patients had to be discharged from a Mayo Clinic hospital 
in Rochester, MN, from January 1, 2004 through Novem- 
ber 30, 2011; 3) patients had to be residing in Olmsted 
County, MN; and 4) patients had to have a primary dis- 
charge diagnosis of COPD, regardless of COPD etiology 
(diagnosis-related group [DRG] code 088 and COPD- 
related International Classification of Diseases [ICD]-9 
codes 491.xx, 492.xx, 493.xx, and 496). 611 The ICD-9 
codes are consistent with National Quality Forum COPD 
codes. The exclusion criteria were: 1) patients who declined 
research authorization (as dictated by Minnesota Statute 
144.335), 2) prisoners, 3) patients who expired during their 
hospital stay, 4) patients who left against medical advice, 
5) patients who had planned readmissions using Agency for 
Healthcare Research and Quality (AHRQ) classifications, 



and (6) patients with COPD as a secondary diagnosis. 
The study was approved by the Mayo Clinic Institutional 
Review Board. 

Both the predictor and outcome variables were retrieved 
from Mayo Clinic administrative databases. An outpatient 
visit to the patient's PCP or pulmonary physician within 
30 days of the discharge date was defined as follow-up care 
for that admission. Outpatient physician visits were cap- 
tured using Health Care Financing Administration current 
procedural terminology evaluation and management codes 
99211-99220 12 (established patient encounter). PCPs and 
pulmonologists were flagged and recorded by the computer 
analyst. An important note is that all patients with discharge 
disposition to a nursing home are cared for by embedded 
Mayo Clinic PCPs, allowing full capture of administrative 
data on these patients. To avoid clustering of events at the 
patient level, we included only one admission per patient 
in a 30-day period for the index visit. Therefore, the next 
index admission date was considered for analysis if the 
event occurred outside the 30-day period of the last index 
admission. No follow-up visits after the occurrence of the 
primary outcome were considered, even if they occurred 
within the 30 days of index discharge. 

Data on important confounders, such as age, hospital 
length of stay (LOS), and comorbidities, were also collected. 13 
All confounding variables with significant association were 
included in the multivariate analysis. To ensure data validity 
and integrity, every fifth random patient from a data set was 
verified by a manual review of medical records. If an error 
was found, the data-extraction program was revisited and 
modified until the accuracy approximated 99%. 

Assuming 20% of patients discharged with a primary 
diagnosis of COPD were readmitted within 30 days, and half 
of those patients were seen by a PCP or pulmonologist prior to 
that event, we estimated that a log-rank test with a two-sided 
significance level of 0.05 would have 80% power to detect the 
difference of PDF rates in 30 days between 23% and 1 7%, ie, 
a hazard ratio (HR) of 0.713 for 1,400 discharges. 

Patient characteristics were compared between patients 
with a follow-up visit and patients without a follow-up 
visit with either the PCP or pulmonologist within 30 days 
of discharge. A two-sided Mest was used for continuous 
variables, and Pearson's x 1 test f° r categorical variables. 
These baseline characteristics were summarized using 
mean (+ standard deviation) for continuous variables 
and frequency (%) for categorical variables. The HRs for 
follow-up visits and the corresponding 95% confidence 
intervals (CIs) were estimated by a Cox proportional hazards 
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model. These calculations used patients having no follow-up 
with their PCP or pulmonologist as a reference group. To 
obtain multivariate-adjusted HRs, the adjusted covariates 
were age, Charlson Comorbidity Index (CCI), number of 
COPD admissions, and index LOS. The Cox proportional 
hazards model was also used to identify factors associated 
with a follow-up visit within 30 days. The Kaplan-Meier 
method was used to plot the log of cumulative HRs against 
time for patients with and without follow-up visits. The 
log-rank test was used to identify the cutoff values for 
significant risk factors. All patients were censored after 
readmission, ED visit, death, and at 30 days after discharge. 
All reported P-values were two-sided, and P<0.05 was 
considered statistically significant. The data analysis was 



generated using SAS software version 9.3 (SAS Institute, 
Cary, NC, USA). 

Results 

Our study cohort initially consisted of 7,102 unique patients 
who were discharged from a Mayo Clinic hospital in Rochester, 
MN and resided in Olmsted County, MN from January 1 , 2004 
through November 30, 20 1 1 with any mention of COPD (DRG 
code of 088). Of those patients, 6,041 had COPD listed as a 
secondary discharge diagnosis and were excluded. Sixty-six 
patients were excluded because they declined research autho- 
rization. Also excluded were 146 patients who did not meet the 
age requirement (18 years), or AHRQ readmission criteria or 
left against medical advice, and ten patients who died during 



7,102 unique patients discharged with any mention of COPD between 01/01/2004 and 11/30/2011 



1,061 unique patients discharged with COPD listed as the primary discharge diagnosis 



• 10 patients died during index hospitalization 

• 66 patients declined research authorization 

• 146 patients excluded based on age and 
AHRQ readmission exclusion criteria 



839 patients with 1,422 discharges, who met all the inclusion criteria 




No postdischarge 
PCP/pulmonary follow-up 
(n=449) 

• 69% - 30 days no event (n=310) 

• 18% - 30 days readmission (n=81) 

• 7% - 30 days ED visit (n=33) 

• 6% - 30 days death (n=25) 



Postdischarge 
PCP/pulmonary follow-up 
(n=973) 

• 72% - 30 days no event (n=702) 

• 19% - 30 days readmission (n=188) 

• 7% - 30 days ED visit (n=72) 

• 2% - 30 days death (n=17) 



Figure I Study flow diagram of patients who met all the inclusion and exclusion criteria. 

Abbreviations: COPD, chronic obstructive pulmonary disease; AHRQ, Agency for Healthcare Research and Quality; PCP, primary care physician; ED, emergency department. 
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the index admission. As seen in Figure 1, the resulting 839- 
patient cohort that met study inclusion criteria accumulated 
1 ,422 index discharges with a primary diagnosis of COPD. The 
division and percentage of patients with and without follow-up 
and their primary outcomes is also illustrated in Figure 1. 
Based on COPD DRG codes, 611 71% had a COPD-related 
ICD-9 code (49 1 .xx, 492.xx, or 496) listed as the primary diag- 
nosis. Asthma (ICD-9 code 493 .xx) was listed as the primary 
diagnosis in an additional 29% of these admissions. 

Demographics and clinical characteristics of patients 
with and without follow-up visits are summarized in Table 1 . 
Between 2004 and 201 1, 68% of patients with COPD had 
an outpatient visit within 30 days of discharge, of whom 
81% had follow-up with their PCP and 19% had follow-up 
with a pulmonary specialist. The mean age of the cohort was 
66 years. Women comprised 59% of the patients, and 79% 
of the patients were white. 

The end-point outcomes are shown in Table 2. The HRs 
for readmission (1.02, CI 0.80-1.32; P=0.84) or an ED 
visit (0.97, CI 0.77-1.2; P=0.80) were not significantly 
different for patients who had a follow-up compared to 
patients who did not, after controlling for age, sex, CCI, 
index LOS, and cumulative admissions per patient for 
COPD (Figure 2A). However, a significant mortality 
reduction was noted with follow-up visits (HR 0.28, CI 
0.15-0.52; P<0.001) (Figure 2B). When all end points, 
30-day readmissions, ED visits, or death were combined, 
PDF was not statistically significant between the follow-up 
versus the no-follow-up group (HR 0.85, CI 0.69-1.05; 
^=0. 13) (Figure 2C). 



Table I Comparison of characteristics of patients with and 
without a follow-up visit with their primary care physician or 
pulmonologist following hospitalization for COPD 



Characteristics 


All patients 


No postdischarge 


Postdischarge 




(n= 1,422) 


follow-up (n=449) 


follow-up 








(n=973) 


Age (n + SD) 


66±I7 


64±I8 


67±I6 


LOS (days ± SD) 


2.89±3.08 


3.04±3.70 


2.82±2.75 


CCI (n ± SD) 


2.49±2.2I 


2.32±2.I9 


2.57±2.2I 


Cycles (n + SD), 


2.53±2.36 


2.42±2.28 


2.59±2.39 


range (min-max) 


(1-15) 


(1-13) 


(1-15) 


Male sex, n (%) 


585 (41) 


187 (42) 


398 (41) 


Race, n (%) 








White 


1,1 17 (79) 


325 (72) 


792 (81) 


Black 


83 (6) 


41 (9) 


42(4) 


Others 


222 (16) 


83 (18) 


139 (14) 


English- 


1,056 (74) 


327 (73) 


729 (75) 


speaking, n (%) 









Abbreviations: SD, standard deviation; CCI, Charlson Comorbidity Index; 
COPD, chronic obstructive pulmonary disease; LOS, length of stay; min, minimum; 
max, maximum. 



We also noted that the risks for readmission or death 
were influenced by other factors. Table 3 summarizes the 
factors that were significant, as well as those that were not 
significant, for predicting the likelihood of readmission, ED 
visit, and death. For both readmissions and ED visits, only 
CCI and the number of COPD admissions were significant 
for predicting the likelihood of the end point. For mortality 
no follow-up, older age, CCI, hospital LOS, and the number 
of COPD readmissions were significant predictors. 

Discussion 

Unplanned preventable readmissions and deaths are 
important outcomes of hospital care, and a decrease in 
their frequency is an important and desirable outcome 
for patients and health care providers. A posthospital 
follow-up visit is considered by many providers as best 
practice, and has been suggested by some authors as a 
universal intervention or modifiable factor that can reduce 
readmission rates. Furthermore, the literature has tended 
to group all patients and all diagnoses in one pool, sug- 
gesting all patients and diseases might benefit equally 
from follow-up care. In this study, we carefully examined 
outcomes for COPD patients who had a follow-up visit 
with a pulmonologist or their PCP. We did not identify 
significantly different rates of 30-day readmission or 
30-day posthospital ED visits in patients who attended a 
follow-up visit in our study cohort. However, we did find 
a statistically significant improvement in mortality for 
patients who had an outpatient follow-up visit. We do not 
have a good explanation for this finding, but it may be an 
inadvertent selection bias, with sicker patients avoiding 
or unable to attend follow-up visits. 

The current literature on follow-up visits has shown mixed 
results. It is important to recognize that there are relatively 
few studies on this question, and most of the studies have 
grouped diverse diagnoses and populations together, making 
the assumption that follow-up care would have the same effect 
for all patients. Both Sharma et al 6 and Sin et al 14 reported that 
a follow-up visit after discharge reduced the risk of readmis- 
sion and ED visits for COPD and asthma patients. On the 
other hand, Grafft et al 15 reported that a scheduled follow-up 
appointment was not associated with decreased readmissions 
or mortality in general medicine patients. Weinberger et al 16 
reported that improved access to primary care following 
hospital discharges for older patients with diabetes, COPD, 
or congestive heart failure was associated with increased rates 
of readmissions (P=0.005). Consistent with Grafft et al 15 and 
Weinberger et al, 16 this study found that readmission rates 
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Table 2 Hazard ratios of 30-day hospital readmission, ED visit, death, readmission + ED visit, and postdischarge failure (readmission, 
ED, and death combined) for patients who had follow-up compared to patients who did not 



Outcomes 


Rate (%) 


Unadjusted HR (95% CI) 


P-value 


Adjusted HR" (95% CI) 


P-value 


Readmission 


188 (19) 


1.07 (0.83, 1.37) 


0.59 


1.02 (0.80-1.32) 


0.84 


ED visit 


72 (7) 


1.01 (0.80, 1.27) 


0.94 


0.97 (0.77-1.22) 


0.80 


Death 


17(2) 


0.31 (0.17, 0.57) 


0.001 


0.28 (0.15-0.52) 


<0.00l 


Readmission + ED visit 


260 (26) 


0.98 (0.79, 1.22) 


0.86 


0.95 (0.76-1.18) 


0.63 


Postdischarge failure 


277 (28) 


0.89 (0.72, 1 .09) 


0.25 


0.85 (0.69-1.05) 


0.13 



Note: a Adjusted for age, sex, Charlson Comorbidity Index, length of stay, and number of admission cycles. 
Abbreviations: ED, emergency department; HR, hazard ratio; CI, confidence interval. 



and ED visits in patients with follow-up visits were not sig- 
nificantly different compared to patients without follow-up 
with their PCP and/or pulmonologist (P>0.05). 

It is important to note that the average national read- 
mission rate is 19.3%. Conversely, approximately 80.7% 
of patients are not readmitted. 1 Therefore, applying such 
interventions as scheduling follow-up visits to reduce 
readmissions for every patient who is discharged from the 
hospital may not be efficient or cost-effective in our current 
health care environment. We reviewed a number of post- 
discharge-care models that identified factors predictive for 
early readmission in general medical patients. 17-22 The lit- 
erature has demonstrated that exacerbations of COPD are 
not random events. Instead, these admissions are clustered 
in time, such that there is a high-risk period for recurrence 
within 8 weeks after the initial exacerbation, with higher 
chances of readmission during this interval. 1 While we did 
not adjust for this in our study, there is a critical need to 
better understand and identify readmission patterns and 
risk factors for common diseases if we are to effectively 
improve readmission rates and individualize health care 
interventions. 

Kansagara et al 17 performed a systematic review for 
risk-prediction models for hospital readmissions, and sug- 
gested that most current readmission risk-prediction models 
perform poorly for predicting readmission. Other studies have 
reported that having more than three COPD admissions in 
the year before recruitment was found to be associated with 
an increased risk of readmission. 18-20 In our study, we identi- 
fied a CCI value of greater than 3, a hospital LOS greater 
than 3 days, and at least six prior admissions with a primary 
discharge diagnosis of COPD as risk factors predicting the 
likelihood of postdischarge events. We found that CCI, the 
absence of a follow-up visit, age, and hospital LOS contrib- 
uted to predicting 30-day mortality. Ideally, application of an 
evidence-based "relapse risk profile" for every patient at the 
time of hospital admission that included CCI and other estab- 
lished risk factors, 19 " 21 and accompanied by the application 



of proven and patient-specific interventions, could be useful 
for reducing readmissions while minimizing resource use. 
However, based on this study, it is unclear that follow-up visits 
are helpful for reducing readmissions for patients discharged 
with a primary diagnosis of COPD. 

In our cohort of patients, the most common readmission 
diagnosis, as described by the ICD-9 coding scheme, was 
chronic bronchitis (ICD-9 code 491.xx), at 29.4%. Other 
unspecified diseases of the lung (ICD-9 code 5 1 8.xx), heart 
failure (ICD-9 code 428. xx), pneumonia (ICD-9 code 486. 
xx), and asthma (ICD-9 code 493. xx) accounted for 6.8%, 
6.3%, 5.7%, and 5.4% of readmissions, respectively. Cumula- 
tively, the majority of the patients discharged with a primary 
diagnosis of COPD were readmitted for pulmonary-related 
complications. 

Our retrospective cohort design has several limitations. 
We did not identify patients who may have been readmitted 
or who may have had a follow-up visit with a health care 
provider at another institution. We mitigated this limitation 
by limiting our cohort to patients residing in our immediate 
county who would be unlikely to access health care elsewhere 
due to the limited options other than Mayo Clinic facili- 
ties. Any such errors would be small, and unlikely to have 
affected our outcomes. We excluded patients who had AHRQ 
exclusion diagnoses, but some of these events may have been 
inadvertently captured. To limit this, we manually validated 
multiple random samples of readmission and ED visits for 
DRG and ICD-9 codes. 

Another possible limitation could be the quality of 
care during the index hospitalization. We were unable to 
collect data and adjust for choice of treatment, length of 
treatment, or adherence to treatment for each admission, 
which could affect outcomes. While we did not measure 
these variables, COPD patients at Mayo Clinic receive con- 
sistent and standardized care, with most patients admitted 
to a specialty pulmonary service. Also, ED and outpatient 
physician practice patterns can influence the decision to 
admit a patient independently of a patient's clinical status; 
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we did not examine this in our study, 1 nor did we exam- 
ine other care coordination, such as early discharge to 
pulmonary rehabilitation, home visits from a respiratory 
therapist, or nurse or self-management education. All are 
potentially beneficial in reducing COPD exacerbations; 1819 



however, few if any such activities were occurring at Mayo 
Clinic during the time frame of this study. 

Not adjusting for the severity of COPD is an impor- 
tant limitation of our study. However, we calculated 
CCI, incorporating factors that measured the patients' 
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Table 3 Hazard ratios for risk factors of readmission, 


ED visit, 


and death within 30 days of dischar 






Risk factors 


Ha.za.rd ratio 


P" val li e 




t * J /o V_ 1 1 




Readmission 






PCP/pulmonary follow-up 


1 .03 (0.80-1 .32) 


0.84 


Age 


1.01 (0.99-1.01) 


0.19 


Male sex 


1 \1 if\ QQ 1 A1\ 

\ . \ 5 [y.07— 1 AL) 


0.32 


Charlson Comorbidity Index 


1 \1 { \ f\Q 1 1 ~7\ 
I .1 J ( 1 .1)7— I.I/) 


<0.0I 


Length of hospital stay 


1.03 (0.99-1.05) 


0.07 


Number of COPD admissions 


1.13 (1 .08- 1.19) 


<0.0I 


ED visit 






PCP/pulmonary follow-up 


0.97 (0.77-1 .23) 


0.80 


Age 


i nn /n r\n i r» i \ 

1.00 (0.99-1.01) 


0.93 


Male sex 


1 1 4 (C\ Q 1 1 4")\ 
1 . 1 *t ^U.7 1 — 1 .^Z ^ 


0.25 


( n ^ v\ zr\ n \ r~\ xw r~\v\\ \ X\i nnciv 
• 1 ld.1 li<~>l 1 v_C>l II CM UIUI Ly II lUtA 


1 n fl 09- 1 1 81 

1 . 1 J 11 . / — 1 . 1 Ol 


<0.0I 


Length of hospital stay 


i m qq i r\4\ 

1 .UZ ^U.77— 1 .U*t) 


U.ZO 


Number of COPD admissions 


i n n nfl_ i i 

i . i j y \ .uo- 1 . i oj 


<0.0I 


Death 






PCP/pulmonary follow-up 


0.28 (0. 1 5-0.52) 


<U.U 1 


Age 


1.06 (1.03-1.09) 


<0.0I 


Male sex 


1.24 (0.67-2.31) 


0.50 


Charlson Comorbidity Index 


1.15 (1.05-1.26) 


<0.0I 


Length of hospital stay 


1.06 (1.03-1. 10) 


<0.0I 


Number of COPD admissions 


1.21 (1.06-1.38) 


<0.0I 


Abbreviations: CI, confidence interval; COPD, chronic obstructive pulmonary 



disease; ED, emergency department; PCP, primary care physician. 

overall state of health. Socioeconomic status, a possible 
confounder, was not considered. The apparent mortal- 
ity benefit may have been related to selection bias, and 
merits further study 

Using binary variables (yes/no), measurement precision 
was not an issue, and increasing the sample size could have 
further decreased the likelihood of random error. Our power 
statement demonstrated the ability of our study to detect 
significant differences between groups. 

We believe that the results from our study are valid for 
the population and setting we studied (a single center in 
the Midwest region of the US). Further study is required 
to provide validation of these results for all COPD patients 
and in other settings. In determining the value of follow-up 
visits, it is important to establish which, if any, outcomes 
can be affected, especially since many patients in the US do 
not have ready access to follow-up care. In addition, none 
of the studies we are aware of, including this one, explored 
the content and process of a posthospital follow-up visit. 
Physicians are more likely to focus on symptoms and treat- 
ment when other factors, such as the ability to afford and 
properly take medications and treatment, as well as patient 
education about triggers for treatment escalation, could be 
more appropriate activities at follow-up. 



Conclusion 

Postdischarge follow-up did not significantly reduce 30-day 
readmissions, ED visits, or the combined measure of PDF, 
but postdischarge follow-up did have a statistically significant 
effect on the mortality of patients with COPD. Identifying and 
reducing avoidable readmissions has the potential to improve 
patient safety and satisfaction, enhance quality of care, and 
reduce health care spending. Further study is necessary 
regarding the benefit of follow-up for other diseases. If, in 
contradiction to these results, follow-up visits are eventually 
demonstrated to be effective for reducing readmissions for 
COPD patients, it is likely that such follow-up visits would 
need to be scripted and standardized to specifically achieve 
that aim. CMS began penalizing hospitals with higher rates 
of readmission for acute myocardial infarction, conges- 
tive heart failure, and pneumonia on October 1, 2012, and 
will expand penalties to other diagnoses, including COPD, 
in 2015. Therefore, it is urgent that we develop a better 
understanding of what factors identify at-risk patients and 
what interventions might reduce the risk of readmission for 
subpopulations of patients, in order to improve care and to 
direct health care resources effectively. 
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